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Abstract. The concept of Jeans gravitational instability is rediscussed in the framework of nonextensive statistics 
and its associated kinetic theory. A simple analytical formula generalizing the Jeans criterion is derived by 
assuming that the unperturbed self-gravitating collisionless gas is kinetically described by the q-parameterized 
class of power law velocity distributions. It is found that the critical values of wavelength and mass depend 
explicitly on the nonextensive g-parameter. The standard Jeans wavelength derived for a Maxwellian distribution 
is recovered in the limiting case q=l. For power-law distributions with cutoff, the instability condition is weakened 
with the system becoming unstable even for wavelengths of the disturbance smaller than the standard Jeans length 
Aj. 
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1. Introduction 

In a seminal paper, James Jeans discussed the conditions 
under which a fluid becomes gravitationally unstable 
under the action of its own gravity (Jeans 1929). 
Nowadays, for any relevant length scales in the Universe 
(stars, galaxies, clusters, etc), such an instability has 
been recognized as the key mechanism to explain the 
gravitational formation of structures and their evolution 
in the linear regime. 

A noteworthy conclusion of Jeans' work is that 
perturbations with mass greater than a critical value Mj 
(Jeans' mass) may grow thereby producing gravitationally 
bounded structures, whereas perturbations with a mass 
smaller than Mj do not grow and behave like acoustic 
waves. This gravitational instability criterion remains 
basically valid and plays a fundamental role even in 
the expanding Universe (Peebles 1993; Coles & Lucchin 
1995). In terms of the wavelengths of a fluctuation, Jeans' 
criterion says that A should be greater than a critical value 
A j = \J Trv^/(Gpo), which is named the Jeans' length. In 
this formula G is the gravitational constant, po is the 
unperturbed matter density and v s is the sound speed 
for adiabatic perturbations. As is widely known, the same 
criterion also holds for a collisionless self-gravitating cloud 
of gas, except that the sound speed v s is replaced by the 
velocity dispersion a. As explained in many textbooks 
(see, for instance, Binney & Tremaine 1987), such a result 
follows naturally from a kinetic theoretical approach based 
on the the Vlasov equation, where the evolution of the 



collisionless gas is ultimately described by perturbing the 
equilibrium Maxwellian velocity distribution. 

On the other hand, some recent studies involving 
the statistical description of a large variety of physical 
systems revealed that some extension of the standard 
Boltzmann-Gibbs approach should be needed. Particular 
examples are systems endowed with long duration 
memory, anomalous diffusion, turbulence in pure-electron 
plasma, self-gravitating systems or more generally systems 
endowed with long range interactions. In order to 
work with such problems, Tsallis (1988) proposed the 
following generalization of the Boltzmann-Gibbs (BG) 
entropy formula for statistical equilibrium (see also 
http.tsallis.cat.cbpf.br/biblio.htm for an extensive and 
updated list of problems and references) 
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where ks is the Boltzmann constant, pi is the probability 
of the ith microstate and q is a parameter quantifying the 
degree of nonextensivity. In the limit q — > 1 the celebrated 
BG extensive formula, namely 
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is recovered. One of the main properties of S q is 
its pseudoadditivity. Given a composite system A + 
B, constituted by two subsystems A and B, which 
are independent in the sense of factorizability of the 
microstate probabilities, the Tsallis measure verifies 
S q (A + B) = S q (A) + S q (B) + (1 - q)k B 1 S q {A)S q (B). 
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In the limit q — ► 1, S q reduces to the standard 
logarithmic measure, and the usual additivity of the 
extensive BG statistical mechanics and thermodynamics 
is also recovered. Thus, if q differs from unity, the 
entropy becomes nonextensive (superextensive if q < 1, 
and subextensive if q > 1), with the Boltzmann factor 
generalized into a power law. In other words, \q — 1| 
quantifies the lack of extensivity of the system. 

A large portion of the experimental evidence support- 
ing Tsallis proposal involves a non-Maxwellian (power- 
law) equilibrium distribution function associated with the 
thermostatistical description of the classical A^-body prob- 
lem. This equilibrium velocity ^-distribution may be de- 
rived from at least three different methods: (i) Through a 
simple nonextensive generalization of the Maxwell ansatz, 
which is based on the isotropy of the velocity space (Silva 
et al 1998); (ii) Within the nonextensive canonical ensem- 
ble, that is, maximizing Tsallis entropy under the con- 
straints imposed by normalization and the energy mean 
value (Abe 1999) (iii) Using a more rigorous treatment 
based on the nonextensive formulation of the Boltzmann 
-ff-theorem (Lima et al. 2001). 

In the astrophysical context, the nonextensive equilib- 
rium velocity distribution related to Tsallis' statistics has 
been applied to stellar collisionless systems (Plastino & 
Plastino 1993), as well as to the peculiar velocity function 
of galaxies clusters (Lavagno 1998). In the former paper, 
the entropy nonextensive formula was maximized taking 
into account the constraints imposed by the total mass and 
energy density. It was found that the solutions behave like 
stellar polytropes and that the mass is finite if the nonex- 
tensive parameter is bounded by q < 9/7. More recently, a 
more detailed account for spherically symmetric systems 
involving cither the gravothermal instability (Taruya & 
Sakagami 2002, Chavanis 2002), or the complete determi- 
nation of the density profiles has been presented in the 
literature (Lima & de Souza 2002). 

Applications in plasma physics are also important 
in their own right, both from a methodological and 
physical viewpoint. In this case, some metastable states 
in pure electron plasmas, and the dispersion relations for 
an electrostatic plane-wave propagation in a collisionless 
thermal plasma (including undamped Bohm-Gross and 
Landau damped waves) have also been studied and 
compared to the standard results (Boghosian 1996; Lima 
et al 2000). In particular, Liu et al (1994) showed a 
reasonable indication for the non-Maxwellian velocity 
distribution from plasma experiments. All this empirical 
evidence deal directly or indirectly, with the ^-distribution 
of velocities for a nonrelativistic gas. 

In the present work, we quantify to what extent the 
nonextensive effects modify the gravitational instability 
criterion established by Jeans. For this enlarged frame- 
work, we deduce a new analytical expression for the Jeans 
dispersion relation which gives rise to an extended insta- 
bility criterion in accordance with Tsallis thermostatistics. 



2. Nonextensive Gravitational Instability 

In what follows, we focus our attention on the kinetic de- 
scription of a many particle system within the nonrela- 
tivistic gravitational context. More precisely, we consider 
an infinite self-gravitating collisionless gas described by a 
distribution function /(v, r, t) slightly depart from equi- 
librium. If fo(v) corresponds to the unperturbed homo- 
geneous and time-independent equilibrium distribution, 
sometimes referred to as the "Jeans Swindle" , the result- 
ing particle distribution function may be approximated 
as 



/ = /o(«) + /i(v,r,t) , /i«/ 



(3) 



where /i is the corresponding perturbation in the 
distribution function. Following standard lines, the 
dynamic behavior of this system can be described by the 
linearized Vlasov and Poisson equations. By neglecting up 
to second-order terms in the expansion of the distribution 
function one obtains 
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where </>o( r ) and </>i(r) are, respectively, the unperturbed 
gravitational potential and its first order correction. As 
is well known, if the "Jeans Swindle" is assumed, one 
may set the unperturbed potential 0o = 0. In this 
case, the solutions of the above equations can be written 
as /i(r, v, t) = i^(v)exp{i(k • r — u)t)} and 0i(r, t) = 
</>exp{i(k • r — tot)} provided that F(v) and <f> satisfy the 
relations 
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Combining these expressions one obtains the dispersion 
relation between u> and k 
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The standard instability analysis follows from the 
above dispersion relation when one takes /o(v) as the 
Maxwellian velocity distribution. 

Consider now the g-nonextensive framework proposed 
by Tsallis. In this case, the equilibrium distribution 
function /o(v) can be written as (Silva et al 1998; Lima 
et al 2000) 



/o(v) = 



ppB q 
(27TCT 2 ) 3 / 2 
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where the normalization constant reads 
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for q > 1, and 
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for | < q < 1. Here er is the velocity dispersion and po is 
the equilibrium density. As one may check, for q < 1/3, 
the ^-distribution (^) is unnormalizable, while for q > 1, it 
exhibits a thermal cutoff on the maximum value allowed 
for the velocity of the particles, which is given by 



/ 2q 2 
~ T 



(12) 



This thermal cut-off is absent when q < 1, that is, w ma £c 
is also unbounded for these values of the g-parameter. 
In this connection, it is worth noticing that the spirit of 
the iJ-theorem is totally preserved for this nonextensive 
velocity distribution. As a matter of fact, by introducing a 
generalized collisional term, C q (f), it has been shown that 
the entropy source is definite positive for q > 0, and does 
not vanish unless the g-equilibrium distribution function 
assumes the above power-law form (Lima et al. 2001). 
In addition, taking into account that limui^oo T(z + 
a)/[z a T(z)) = 1, as well as that lim g ^i[l — (q — 
1 j a .2]i/(,-i) = CX p(_ x 2) (Abramowitz & Stegun 1972), 

the expressions @ and Q defining B q reduce to B x = 
1, and as should be expected the distribution function fo 
reduces to the exponential Maxwellian distribution 



/o(v) = 



Po 



(2trj 2 ) 3 / 2 
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In Fig. 1 we have plotted the nonextensive distribution as 
a function of v for some selected values of the q parameter. 
As can be seen, for q > 1 the distribution exhibits a 
cutoff on the maximum value allowed for the velocity of 
the particles. In the limit q — > 1 we see from ( |l2| ) that 
Vmax — ► oo and the power-law behavior reduces to the 
exponential Maxwellian distribution. For q < 1 the cutoff 
is also absent with the curves decreasing less rapidly than 
in the Maxwellian case. Note also the convergence from 
power-law to the standard Gaussian curve as long as the 
q parameter approaches unity. 

Now, substituting the nonextensive equilibrium distri- 
bution given by (||) into the dispersion relation (j^) one 
finds 
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where the v x axis has been chosen in the direction of k. 

In the study of Jeans instability, the boundary between 
stable and unstable solutions is achieved by setting u> = 
in dl4| ) . For this value of u> the above integral can be easily 
evaluated and the result is a g-parameterized family of 
critical wavenumbers k q given by 
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Fig. 1. Nonextensive velocity distribution function /o(v) 
for typical values of the q parameter. Power law 
distributions with q > 1 exhibits a thermal cutoff on the 
maximum value allowed for the velocity of the particles. 
This cutoff is absent for ^ < q < 1, and the distribution 
is unnormalizable for q < i. 



where kj 2 = AnGpo/cr 2 is the classical Jeans wavenumber 
(Binney & Tremaine 1987). Fro m (|l5|) we have the q- 
wavelength X q = 2ir/k q — Xjy / 2/ (3q — 1) where Aj is 
the Jeans wavelength. Note that the classical value of the 
Jeans wavenumber and wavelength as obtained from fluid 
theory are recovered only if q = 1. For g>l(l/3<g<l) 
the q- wavelength X q is decreased (increased) by the factor 
y/2/(3q — 1). Associated with X q there is a critical mass 
M q , defined as the mass contained within a sphere of 
diameter X q , which is given by M q = ^-p (X q /2) 3 = 
Mj[2/(3q — l)] 3 / 2 , where Mj is the critical Jeans mass. 
Similarly, we see that forg>l (l/3<g<l) the critical 
mass is decreased (increased) by the factor [2/(3q— l)] 3 / 2 . 
Therefore, in comparison with a Maxwellian gas (q = 1), 
a nonextensive collisionless self-gravitating system is more 
(or less) unstable depending on the value assumed by the 
q-parameter. 

Let us now discuss in more detail the unstable modes. 
As happens in the perturbed fluid theory, fluctuations 
with wavelengths A > Xj will be unstable. In order to 
check what happens in the present kinetic approach we 
set u> — «7, where 7 is real positive, and insert this into 
the dispersion relation (p^). As before, choosing the v x 
axis in the direction of k, the following dispersion relation 
is obtained 



k' 2 



(15) 
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where (3 = j/^/2ka and I q (/3) is a q-dependcnt integral 
given by 



^fi£(^T+j)g + i 

=T [1 - (q - l)x 2 ] ^ 



/ /3 2 +.X 2 
for q > 1 and 



dx 



(17) 



IM= r^-i) U ^ dx (18) 

for 1/3 < g < 1. It should be noticed that the limit q — > 1 
of both expressions is 

lim/,(/3) = - / __d a; = _[l-erfC8)] ,(19) 



with the expression (nff) reducing to 



= 1 - V^e [1 - erf (/?)] 



(20) 



which is the standard dispersion relation for stellar 
systems (Binney & Tremaine 1987). For an arbitrary value 
of q, the dispersion relation is given explicitly by the 
integral form (^) which can be numerically evaluated. In 
Fig. 2 we plot the unstable branches for several values 
of q along with the dispersion relation for an infinite 
homogeneous fluid which is given by the solid straight line 
(see Binney & Tremaine 1987 for comparison). 

As can be seen from these plots, for q > 1 
the system presents instability even for wavenumbers 
of the disturbance greater than the standard critical 
Jeans value (kj). In other words, this kind of q-gaseous 
system is more unstable than the one described by 
the standard Maxwellian curve, and therefore, structures 
are more easily formed in this nonextensive context. 
However, for q < 1 the system may remain stable even 
for disturbance with a wavenumber smaller than the 
Jeans wavenumber. This yields a generalization of the 
Jeans gravitational instability mechanism within Tsallis' 
nonextensive thermostatistical context. The standard 
Jeans criterion is thus modified with critical values of mass 
and length depending explicitly on the nonextensive q- 
parameter. 

In Fig. 3 new plots of the dispersion relation (unstable 
branches) are presented. Different from Fig. 2, instead of 
the ratio involving the critical Jeans wavenumber (kj), 
the behavior of the unstable branches are analyzed as a 
function of the ratio k/k q . 

As should be expected at first sight, the curves are 
convergent for the critical ratio (k/k q — 1), but the growth 
rates are slightly different for each value of q. Note also 
that for all values of q, the results are quite different 
to what happens in the macroscopic fluid approach for 
gravitational instability (solid straight line). 
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Fig. 2. Unstable branches of the dispersion relations 
for an infinite self-gravitating collisionless gas obeying 
the nonextensive Tsallis g-statistics. For comparison the 
straight line representing the dispersion relation for an 
infinite homogeneous fluid has also been plotted. We see 
that for q > 1 (power-law distributions with cutoff), the 
system is unstable even for wavelengths smaller than the 
standard Jeans length value (A,/). 

3. Final Remarks 

We have discussed the Jeans gravitational instability 
along the lines of the nonextensive statistical formalism 
proposed by Tsallis. In this extended kinetic framework, 
the Gaussian phase space density is replaced by a 
family of power law distributions parameterized by 
the nonextensive g-parameter. An attractive feature of 
Tsallis thermostatistics is that the models are analytically 
tractable in such a way that a detailed comparison with 
the extensive Maxwell-Boltzmann approach is readily 
achieved. 

The main interest of our results rests on the fact 
that the Maxwellian curve may provide only a very 
crude description of the velocity distribution for a self- 
gravitating gas, or more generally for any system endowed 
with long range interactions. As we have seen, a well 
determined criterion for gravitational instability is not a 
privilege of the exponential velocity distribution function, 
but is shared by an entire family of power-law functions 
(named q-exponentials) which includes the standard Jeans 
result for the Maxwellian distribution as a limiting case 
(q = 1). In general, the basic instability criterion is 
maintained: perturbations with k > k q do not grow (or 
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Fig. 3. Unstable branches of the dispersion relations as 
a function of the critical wavenumbers k q . Notice that 
the magnitude of k q is related to the critical Jeans 
wavenumber by equation (|l5|). As in Fig. 2, the straight 
solid line stands to the case of an infinite homogeneous 
fluid. 



are damped even considering that the collisionless g-gas is 
a time reversible system), while instability takes place for 
k < k q . However, unlike Jeans' treatment, in this context 
there exists a family of growth rates parameterized by 
the nonextensive g-parameter. In particular, for q > 1 
(power-law distributions with cutoff) the system presents 
instability even for wavenumbers of the disturbance 
greater than the standard critical Jeans value kj. 

Finally, since the gravitational instability Jeans' 
criterion remains basically true for an expanding Universe 
(Coles & Lucchin 1995), the adoption of a power law 
distribution and the resulting nonextensive effects may 
have interesting consequences for the galaxy formation 
process. Such implications will be examined in a 
forthcoming communication. 
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